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ABSTRACT 

Ongoing supernova (SN) surveys find hundreds of candidates, that require 
confirmation for their various uses: as standard candles; to measure the cosmic 
supernova and star formation rates; to constrain progenitor models; and to track 
the contribution of supernovae (SNe) to metal enrichment. Traditional classifi- 
cation based on followup spectroscopy of all candidates is virtually impossible 
for these large samples. The use of type-la SNe as standard candles is at an 
evolved stage that requires pure, uncontaminated samples. However, other SN 
survey applications could benefit from a classification of SNe on a statistical ba- 
sis, rather than case by case. With this objective in mind, we have developed 
the SN-ABC, an automatic Bayesian classifying algorithm for supernovae. We 
rely solely on single-epoch multiband photometry and host-galaxy (photometric) 
redshift information to sort SN candidates into the two major types, la and core- 
collapse supernovae. We test the SN-ABC performance on published samples of 
SNe from the SNLS and GOODS projects that have both broad-band photom- 
etry and spectroscopic classification (so the true type is known). The SN-ABC 
correctly classifies up to 97% (85%) of the type la (II-P) SNe in SNLS, and similar 
fractions of the GOODS SNe, depending on photometric redshift quality. Using 
simulations with large artificial samples, we find similarly high success fractions 



bubble Fellow. 
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for type la and II-P, and reasonable (~ 75%) success rates in classifying type 
Ibc SNe as core-collapse. Type Iln SNe, however, are often misclassified as la's. 
In deep surveys, SNe la are best classified at redshifts z > 0.6, or when near 
maximum. Core-collapse SNe (other than type Iln) are best recognized several 
weeks after maximum, or at z < 0.6. Assuming the SNe are young, as would be 
the case for rolling surveys, the success fractions improve, by a degree dependent 
on the type and redshift. The fractional contamination of a single-epoch pho- 
tometrically selected sample of SNe la by core-collapse SNe, varies between less 
than 10% and as much as 30%, depending on the intrinsic fraction and redshift 
distribution of the core-collapse SNe in a given survey. The SN-ABC also allows 
the rejection of SN "impostors" such as active galactic nuclei (AGNs), with half 
of the AGNs we simulate rejected by the algorithm. SNe may be classified using 
just one or two bands, but three bands are necessary for obtaining a reasonable 
reliability and AGN rejection. Observations in a fourth band may not be worth 
the added observational cost, for classification purposes. Our algorithm also sup- 
plies a good measure of the quality of the classification, which is valuable for 
error estimation. 

Subject headings: supernovae: general 



Introduction 



Supernovae (SNe) are u sually subdivide d into different types, based on spectroscopic 
or photometric criteria (e.g.. lFilippenkolll997l ). The primary physical distinction among the 
common supernova (SN) types separ ates core collapse SNe (CC-SNe), that originate from 
the collapse of a massive star (e.g., IWoosley fc Jankal 120051 ). from type-la SNe (SNe la), 
for which there are com peting scenarios, generally iny olving a thermonuclear runaway in a 
degenerate system (e.g.. Irlillebrandt Sz Niemeyer 2000 ). 

Recent technological advances in wide field imaging and in automation capabilities, combined 
with a growing interest in transient phenomena, h ave led to numerous surveys that find hun 



dreds of SNe. These surveys sear ch for SNe nearby (Filippenko et al. 



2004 ). at intermediate redshif t s (IDildav et al 



shifts ( IPoznanski et al.l 120071 ; lAstier et al 



2005 



2006 



2001 



Cappellaro et a 



Wood-Vasey et al. 



200 51), and at high red - 



Riess et al.l l2004al ISollerman et al.l 120061 ). 



While most ongoing S N searches focus on the use of SNe la as standard candles for cos- 
mological applications (IRiess et al.ll2004al ; lAstier et al.l 120061 ) . large SN samples can be used 
also to study the statistical propert ies of the SNe themselves, and to measure their rates 



as a function of cosmic time (e.g., iMaoz fc Gal- Yam! 12004 ; iDahlen et al.l 12004 ) . Because 
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the lifetimes of massive stars are short compared to cosmological timescales, the rate of 
CC-SNe is expected to follow the star f ormation history, and thu s could provide an inde- 
pendent measure of this function (e.g., iDahlen fc Franssonl Il999l ). The rate of SNe la is 



linked to star formation through a more complicated evolutionary process that depends 



on the nature of the progenitor systems. M easurement o : 



the SN la rate may there 



fore constrain possi 


3le progenitor models (e.g., 


Vladau et al. 


1998: 


Gal- Yam k Mao2 


2004; 


Stroleer ct al. 


2004; 


Scannapieco & Bildsten 200!: 


>;lMannucci et al. 


2005, 


2006; 


Sullivan et al. 


2006b: 


Forster et al 


2006). 



Future projects such a s Pan-STARRS flKaiser et al.ll2005[ ). LSST (IStubbs et al.l 120041 ) . 
and SNAP (jAlderind 120051 ) . promise to increase the yield of SNe by orders of magnitude, 
especially at intermediate and high redshifts. All of the SN studies above require large, well- 
defined samples of SNe with determined types and redshifts. The common methodology of 
attempting to obtain spectroscopic followup of every SN candidate, in order to determine 
its type, its redshift (based on the host spectrum or from the SN spectrum itself), and 
possibly other characteristics, is unsuitable for this plethora of SNe, due to their faintness, 
sheer numbers, or both. For this reason, current surveys usually focus on subsets of the SN 
candidates for which spectroscopic observations can be obtained. Ongoing surveys already 
employ some photometric criteria for prioritizing followup, but usually not for definitive 
classification, as we discuss below. 



In lPoznanski et al.l (120021 ) and lGal-Yam et al.l (120041 ). we showed, using color-color dia- 
grams, that given a known redshift, different types of SNe can often be disting uished based 
on col ors alone. Our method and webtoofj] have been u sed, among others, by Rajala et al. 



(120051 ) . to classify nearb y SNe. by iGal-Yam et al.l (120051 ) to choose objects for followup prior 
to spectroscopy, and by IStrolger et al.l (120041 ) for high re dshift CC-SN ident ification. The 
approach has been developed further by several studies. iRiess et al.l (j2004bl ) showed that, 
at high redshift, it might be even easier to distinguish, near maximum light, between SNe la 
and CC-SNe, by virtue of the difference in the rest frame UV emission between these two 
classes of objects. IJohnson &: Crottsl (120061 ) investigated further the color-magnitude based 
classification of intermediate redshift SNe with different filter sets and both with and with- 



out redshift information. ISullivan et al.l (j2006at ) introduced the use of automatic photometric 



class ification as part of the reduction pipeline of the SN Legacy Survey (SNLS; lAstier et al. 



20061 ). using two to three early light-curve points. The objective was mainly to recognize 
SNe la, with a minimum of fa lse positives and select ion biases, and thus to prioritize tar- 
gets for followup spectroscopy. iBarris fc Tonryl (120061 ) fit complete light curves and applied 



^ttp : //wise-obs . tau. ac . il/~dovip/typing/ 
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various quality cuts i n order to recognize S Ne la among the various transients they found in 
their survey (see also lBarris fc Tonryll2004l ). 



In this paper, we present an algorithm, the SN Automatic Bayesian Classifier (SN-ABC), 
intended for automatic classification of SNe using single-epoch photometry and whatever red- 
shift information is available. The main novelties of our algorithm lie in the probabilistic and 
Bayesian methodologies. Our approach is probabilistic in the sense that we do not expect to 
succeed with the classification of every specific object, but to correctly classify most objects, 
while minimizing biases in the output sample, this by assigning each object its most likely 
type. The flexibility of the Bayesian framework allows us to do so by analyzing SNe from 
different surveys, with different depths and types of redshift information, to incorporate fully 
all the available information on each object, and to propagate correctly the unknowns. As a 
proof of concept, we focus on single-epoch photometry in three bands, but the method can be 
straightforwardly implemented with multiply sampled light curves with other photometric 
setups. As we will show, SNe can be classified quite reliably even with meager input data, 
and therefore numerous SNe can be found and analyzed at a relatively low cost in telescope 
time. 

We test our method on lig ht curves, recently released by the SNL S, of 71 SNe la and 



five "plateau" type (II-P) SNe flAstier et all 12009: iNugent et a 



of 42 SNe found during the GOODS campaign (IDahlen et al 



2006), and on the sample 
20041 ). A third sample of 



simulated SN data is used to investigate potential biases and the efficiency of the method as 
a function of SN and sample parameters. In a separate paper (Poznanski et al. 2007), we 
use our method to cla ssify a sample of SNe we have found in the Subaru Deep Field (SDF; 
Kashikawa et al.l 120041 ). with the objective of measuring the rates of la and CC SNe at high 
redshift based on this dataset. 



Shortly prior to submission of this paper, iKuznetsova fc Connolly! (120071 ) presented a 
Bayesian classification algorithm, and its application to SNLS and GOODS data. Although 
there are some similarities between their approach and ours, there are also some major dif- 
ferences. First, while they use complete light curves, and discuss the importance of such 
data, we focus on single epoch observations, where information is scarce, and classification 
is less obvious. Second, they treat the redshift of the SN as a known quantity without any 
ambiguity. While this is true for most of the SNe in the training samples they (and we) 
use, this is certainly not the case for existing and future SN samples, where methods of 
photometric classification apply. In our work, while we focus on the case where photometric 
redshifts for the host galaxies of the SNe are available, we treat the general case, in which 
each object can have any possible redshift estimation, either precise (spectroscopic) or totally 
unavailable. In each case the uncertainties in the redshift measurement are taken into ac- 
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count. Finally. iKuznetsova fc Connollyl (120071 ) estimate the probabilities after marginalizing 
over three extinction scenarios, (no extinction, Ry = 3.1 with Ay = 0.4 , and Ry = 2.1 with 
Ay = 0.4 ). As explained in §2.2} we assume a range of extinction models with Ry = 3.1, 
and Ay between zero and one. 



2. Method 

Our general approach for SN classification relies on a Bayesian template fitting tech- 
nique. Given a "prior" on the redshift of a SN candidate, we fit a set of template spectral 
energy distributions (SEDs) to the observed photometry of the SN. We then maximize the 
likelihood in order to find the characteristics of the SN, derive the evidence for the object 
being either a SN la or a CC-SN, and find its posterior redshift distribution function. We 
describe below each step in detail. 



2.1. SN Photometry and Prior (Redshift) Information 

We will assume the availability of single-epoch multi-band photometry of the candidate 
SNe. As we will show, this is probably the minimum amount of data that can produce 
scientifically meaningful results, and is also the kind of information we have for the SDF 
(Poznanski et al. 2007). However, this method can be easily applied to cases where more 
information is available, including complete multi-band light curves, with a guaranteed im- 
provement in the results. 

We further assume the existence of a prior redshift probability distribution function 
(z-pdf) for the SNe. Such a prior distribution would come naturally from the photometric 
redshifts of the host galaxies, but in principle could be from any source. Photometric redshifts 
are now being produced by every major extragalactic survey, and for well studied fields there 
may even be an available spectrum of the host galaxy, or one can be obtained later when 
the SN has faded. (In the Bayesian formulation, a spectroscopic redshift corresponds to a 
sharply peaked prior z-pdf.) In cases where there is no redshift information (e.g., because 
the host is too faint) one can assume a flat, or some other physically motivated, z-pdf. 

The Bayesian approach permits a careful treatment of the unknowns, that can be prop- 
agated fully from one step of the analysis to the next. Even when the redshift is derived from 
spectroscopy, it can have uncertainties which are hard to propagate further in any frequen- 
tist approach. Here, we can treat self-consistently redshift information of any given quality, 
whether a narrow peaked z-pdf from a spectral redshift, a broad, or oddly shaped redshift 
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distribution, including redshift limits, or even non-existent photometric redshift, all jointly 
analyzed. Furthermore, when interested in the redshift distribution of the SNe, one can use 
the full posterior redshift distribution for each object, rather than a single value derived from 
its peak, and thus propagate further the complete information. Finally, in "rolling searches" , 
where, e.g., all SNe are found when rising or near peak, one can similarly include a prior on 
the age of the SN, and thus improve the classification. 



2.2. Model 



We use SN templates from the updated version of the SN SEDs of lNueent et all (fmoJE 



These include sets of redshift z = spectra of SNe of different types and at different epochs, 
covering the NIR to the restframe UV. After experimenting with various simulations and 
applications to real data, most of which are presented in Sections [3] and IU we find that the 
best classification, and the fewest subsequent biases, in type and redshift distributions, are 
achieved when only the templates for types II-P and normal (stretch s = 1) la are used in the 
fits. As we will show in §H we find that, with the exception of type Iln SNe (see discussion 
in §1]), most CC-SNe, are more similar, on average, to type II-P than to type la SNe. Since 
our main objective will be an empirical division between the two main physical classes of 
SNe, la and CC, we retain only these two types, using the II-P templates as proxies for 
the whole CC SN class. In general template fitting algorithms, the use of many templates, 
including rela tively rare objects, tends to damage the fit of the more common objects (e.g., 



Bemtez 



20001 ). In our case, adding templates for other CC-SNe, while somehow improving 
the classification of these types of SNe, causes many SNe la to be wrongly classified, and 
thus lowers the overall success rate of our algorithm. We emphasize that while we use those 
two specific template families to measure whether a given object is a SN la or a CC-SN, we 
are concerned with the classification of all types of SNe. Our working assumption (that is 
largely confirmed by the results we present in the following sections) is that most type la 
SNe have colors and magnitudes more similar to those of a normal SN la than to those of a 
type II-P SN, and conversely, that most CC-SNe, including the various subtypes, are more 
similar to a II-P than to a SN la. 

Our adopted templates span a range in SN age, t, from about two weeks prior to 
maximum S-band light to two (three) months past maximum for the la (CC) SNe. Using 
synthetic photometry, we have scaled th e template spectra t o reach at maximum light the 



.B-band absolute magnitudes in Table 1 of lDahlen et al.l (120041 ). which are based on the works 



2 available at http : / / supernova, lbl . gov/^nugent/migentjtemplates .html 
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of iRichardson et al.l (120021 ). iLi et al.l (120011 ). and lTonry et al.l (120031 ). We consider two types 
of intrinsic di s persio n in SN properties - one in the absolute magnitude, which we take from 



Dahlen et al.l (12004 ). and one in color, of 0.1 mag (for whatever color is being considered, 



e.g., r — i, i — z, e t c.). The la t ter is consistent with what has been measured for SNe la by 



Nobili et al.l (120031 ) . I Jha et al.l (120061 ). and Ellis et al. (in preparatio n), while for CC-SNe w e 



are not aware of the existence of similar published data (though see lElmhamdi et al.l 120031 ). 

We apply to the template spectra a grid of redshifts (from to 2) and ext inctions 
{A v = — 1 mag) at the SN redshift, using the ICardelli. Clayton, fc Mathid (119891 ) extinc- 
tion law, with Ry = 3.1. Luminosity distances are calculated using the currently favored 
cosmology {h = 0.7, = 0.7, Q m = 0.3). Finally, we apply a range of observer-frame 
Galactic extinctions to the spectra (from zero extinction to Ay = 0.1, the ma ximal value fo r 



the SN e in the GOODS and SNLS surveys), again using the reddening law of ICardelli et al. 
dl989h . 

We calculate synthetic magnitudes from the SEDs, based on the bandpasses used in the 
particular survey being analyzed. These bandpasses are the products of the filter transmis- 
sion curves, detector quantum efficiency curves, and (for ground-based data) atmospheric 
transmission. We thus obtain a 5d data cube of model magnitudes for each type of SN as 
a function of redshift, age, band, host extinction, and Galactic extinction, from which we 
sel ect for each object a Ad cube a c cordin g to the expected Galactic extinction from the maps 
of ISchlegel. Finkbeiner. &: David (119981 ) . We perform all of our analysis using Vega-based 
magnitudes. 



2.3. Fitting 



For every SN we classify, we calculate two 3d posterior likelihood matrices, one assuming 
it is a SN la, and one assuming it is a CC-SN: 



L type (z, A v ,t) = P(z) ■ exp 



j-v / m mod >i (z, A v ,t) - rrii 

4 \ 



dm; 



with the summation being over the available bands, and denoted here by the index i. P(z) is 
the redshift prior, m mod j are the model magnitudes computed from the templates (see §2.2j) . 
rrii are the measured magnitudes, and drrii are the photometric errors and model dispersions 
summed in quadrature. In order to account for the different dispersions in the absolute 
magnitudes of the model SNe and their colors, we technically do not fit n magnitudes in n 
bands, but rather one magnitude and (n — 1) colors. We marginalize the likelihood function 
over the three parameters, z, Ay, and t, and obtain the summed likelihood for each type of 
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SN, commonly referred to in Bayesian literature (e.g., iGelman et al.lll995l ) as the evidence, 



Etype = J L type (z,A v ,t) dz dAy dt. 



In order to classify the SNe, we define a relative evidence to express the probability that 
an object is a SN la, as 

p = E i* 

Ela + E CC 

We also derive for each SN its posterior redshift, assuming it belongs to a given type of SN, 
by marginalizing the relevant likelihood function over the nuisance parameters, namely the 
age and the extinction. The final output is then the probability for the SN to be of type la, 
rather than being a core-collapse event, and its posterior z-pdf. In the following sections, we 
consider the adopted type of a SN to be the type which has a probability higher than 0.5. 
Naturally, the higher this probability, the more secure is the classification. We also examine 
the x 2 value for the best fitting template, in order to ascertain the goodness of fit in an 
absolute sense, and in order to reject SN impostors, mainly active galactic nuclei (AGNs). 



3. Tests on Real Data 

We now apply our algorithm to two real data sets, SNLS and GOODS, that have 
photometric data of the type we are considering (e.g., SNe observed in at least three bands), 
and followup spectroscopy based upon which we can evaluate the performance of our method. 



3.1. SNLS 



3.1.1. Ia SNe 

We beg i n with 71 published lightcurves of SNe Ia from the SNLS project^], described in 
Astier et al.l (120061 ). The SNLS is a 5- year 'rolling' SN-Ia survey, using the MegaCam wide 
field imager on the 3.6 m Canada- France-Hawaii Telesc ope. The fields are imaged in four 



band s, similar to the Sloan Digital Sky Survey g,r,i,z flFukugita et al.l 119961 ; lAstier et al. 
20061 ). with limiting magnitudes in i of the order of 24.5 mag. The SN candidates are 



confirmed using spectroscopy from 8-10 m class telescopes. The SNe in our sample are all 
spectroscopically confirmed SNe Ia at z — 0.25 — 1, with a median of z = 0.6. Typical 



3 available at http://snls.in2p3.fr/conf/release/ 
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photometric errors are smaller than 0.1 mag. Since our main focus is on classification by 
means of three bands, we ignore at first g-band data (but see §4.41) . and use for each SN 
only those data combinations which have same-day (±1) photometry in r,i,z. This produces 
a sample of 172 'objects', extracted from 58 SNe. This selection does not affect the redshift 
distribution, which remains similar to the distribution of the original sample. 

Since these SNe have spectroscopic redshifts, we create simulated photometric redshifts, 
Zrand! by adding to each object's redshift a normally distributed (with zero mean and o~% 
standard deviation) error, 

2rand = ^spcc + noise((7i), 

and create a Gaussian z-pdf of width a 2, centered on the noise-added redshift, 

^rand) 



Pphot(z) = — = • exp 

a 2 x V27T 



2o\ 



To evaluate the impact of the precision of redshift determination, we have run the SN-ABC 
for various combinations of <j\ and 02 values. For every SN, we perform several specific 2 ran d 
realizations, and average the outcomes. 

In Figured] we present the SN-ABC output Pj a distributions (left) for various precisions 
of redshift determinations, and the posterior redshift compared to the spectroscopic one 
(right). We start with o\ — and 02 = 0.01, which can represent well-determined, i.e., 
spectroscopic, redshifts. In this case ~ 97% of the SNe are correctly classified by the SN- 
ABC. With o\ = 02 = .1, a reasonable precision for photom etric redshifts in most surveys 
and redshift ranges (e.g.. lGrazian et al.ll2006l ; ICoe et al. this result remains unchanged, 



with 97% correctly classified SNe, and ~ 65% having Pj a > 0.9. The posterior redshift scatter 
is marginally reduced, compared to the constructed prior standard deviation of o = 0.1, 
indicating that this precision in redshift is about the limit of what can be achieved with 
single epoch data in three bands. 

For <7i = (72 = 0.3, i.e., very broadly distributed and imprecise redshifts, and probably 
the worst case scenario for photometric redshifts, we correctly classify ~ 76% of the SNe as 
type la, and improve the scatter in the redshift determination from o = 0.3 to an a posteriori 
value of cr ~ 0.17, thus improving the redshift dispersion by almost a factor of 2. On the other 
hand, it can clearly be seen that the posterior redshift distribution is heavily biased towards 
lower z. This is a consequence of the fact that, the lower the redshift, the more freedom the 
minimization has in the other parameters. At lower z the SN template is inherently brighter 
and can be 'aged' and extinguished in order to fit the observed magnitudes, while at higher 
z it must be closer to peak and less extinguished. 

The most extreme scenario is the absence of any prior on the redshift. This is probably 
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relevant only to the few objects that have no measured host due to its faintness. In this case, 
we drop to only ~ 60% correct classifications, only slightly better than random assignment 
of SN type. Not surprisingly, parameter space is wide enough to accommodate both types, 
when no information on the host redshift exists, and the SN light/color curve is so scantily 
sampled. 

We can thus conclude that single epoch photometry in three bands, combined with a 
reasonably well determined host galaxy redshift, is sufficient to recognize SNe la, with only 
a few false negatives, and high confidence levels. 



3.1.2. II- P SNe 

In order to measure the performance of the SN-ABC in correctly classifying CC-SNe, we 
repeat the procedure described in §3.1.1[ applying the same "pse udo photometr i c reds hifts" 



to the much smaller sample of five type II-P SNe, presented in iNugent et al.l (120061 ). We 
extract 25 'objects' with same-day photometry from among three of these SNe, which are at 
redshifts of 0.13 to 0.21. 

As shown in Figure [2J when using the precise spectral redshifts, we achieve a perfect 
success rate with not a single object misclassified. When using broader, more realistic, z- 
pdfs, we reach success rates between 85% {a\ = 02 = 0.03) and 75% (<j\ = o<i = 0.1). 
Since the redshifts of these SNe are significantly lower than those of the SNLS la sample, we 
examine cases with comparatively smaller values of a± and 01 that are more reasonable for 
photometric redshifts in this range. 

In all the simulated photo- z schemes we have examined, both for the la and CC-SNe, 
the minimum x 2 values are lower than the value that defines the 99% confidence interval on 
the goodness of fit, which we derive from simulations, as will be described in §|U below. The 
best fit templates therefore fit the data well in an absolute sense. 

While the tests on the SNLS samples, both type la and II-P, indicate that our algorithm 
works well, these results may be misleading since these samples were selected by the SNLS 
team for their quality, and are not in any sense a complete representation of all the SNe 
found during the survey. The SNLS pipeline includes a color-based pre-selection of objects 
for spectroscopy, and the sample might be biased against SNe la with uncharacteristic colors. 
In order to check our method on a complete sample, we apply the SN-ABC to all of the SNe 
found during the Hubble Space Telescope (HST) GOODS campaign. 
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3.2. GOODS 

We proceed with a SN sample from the GOODS SN survey. As part of this project, two 
fields of about 150 arcmin 2 each were observed with the ACS camer a on HST every 45 days, 



over five epochs, in o rder to search for SNe. We have compiled from lRiess et al.l (j2004al ) and 



Strolger et al.l (120041 ). all available photometry for the 42 SNe found in the GOODS fields. 
These SNe cover a redshift range of 0.2 to 1.55, with a median of 0.76, which is higher than the 
SNLS range. The light-curve coverage is more limited than for the SNLS sample, and not all 
SNe have spectroscopic redshifts or types. However, GOODS is a complete sample, without 
any subsequent selec tion. The SNe were classified following a decision scheme presented in 



Strolger et al.l (120041 ). and the whole sample was divided into three subsets - "gold" , "silver" . 



and "bronze" - according to the reliability of the type determinations. 

As in §3.11 we first reject all the SNe which do not have same day (±1) photometry 
in three bands (in this case F606W, F775W, & F850LP), leaving 28 SNe. After excluding 
one SN with no redshift information, we extract from the remaining 27 SNe (13 la, 14 CC), 
41 same-epoch photometry "objects" , of which 23 are of type la, and 18 are CC. Among 
these 41 objects, 28 (17 la, 11 CC) have spectroscopic redshifts while 13 (6 la, 7 CC) 
have only photometric redshifts. The requirement of same-epoch photometry changes the 
redshift distribution of the sample, mainly by rejecting the few SNe with z > 1, and leaves 
a distribution with a median redshift of ~ 0.6, ranging from 0.2 to 1, similar to the SNLS 
la sample. 

For those SNe with spectroscopic redshifts we create pseudo-photo-z's, repeating the 
approach in §3.11 with a\ — 02 = 0.1. When applied to this sample, the SN-ABC correctly 
classifies 16 of the 17 SNe la and 9 of the 11 CC-SNe. The single SN la which is misclassified 
is the last of three observations of SN 2002hr, a SN la, about two months past maximum 
brightness. The previous two epochs of the same SN are well classified. The misclassified 
CC-SNe are SNe 2002kb and 2003bb. For <7i = 0, cr 2 = 0.01, representing well determined 
spectral redshifts, the success rates remain unchanged for the CC-SNe, but for the SNe la one 
more object is misclassified, one of the three epochs of SN 2002ga, a bronze SN la. Since it 
is well classified with a broader z-pdf, its misclassification may be due to an underestimated 
redshift uncertainty. 

For those SNe with photometric redshifts, we assume a Gaussian pdf with er 2 = 0.1, since 
we do not have the real z-pdfs. For this photo- z sample, we recover the same classification 
as that of the GOODS team for only two of the six SNe la and four of the seven CC-SNe. 
Increasing o"2 to a value of 0.2, to test whether we have underestimated the uncertainty in 
the redshift, does not improve this result. 



-12- 



It is clear that the SN-ABC functions extremely well on the GO ODS SNe with spectro - 



scopic redshifts, mostly in accord with the classification presented in IStrolger et al.l (12004 ). 
while for the SNe with photo-z's there are severe discrepancies. This illustrates the diffi- 
culty to classify SNe without spectroscopy, and it is hard to ascertain which classification 
scheme is correct for every object. If we consider agreement between the GOODS classifi- 
cation and ours as an indicator of the quality of the classification itself (either the SN-ABC 
or GOODS), it is clear that our division of the sample according to the existence or non 
existence of spectral redshift splits the sample into distinct quality classes. This is less true 
for the GOODS gold/silver/bronze quality flags (though one should note that these divisions 
are not independent). For example, our classification of the CC-SNe with spectral redshifts, 
belonging to the bronze sample, is in agreement with the GOODS type for all the objects, 
while it is in disagreement for one of the four bronze CC-SNe with photo-z. More dramat- 
ically, for the silver CC-SNe, neither of the two SNe with photo- z are similarly classified, 
while four out of the five with spectral redshifts are in agreement. Similar trends are seen 
with the type-la SNe. Since all the SNe la in the gold sample have spectral redshifts, this 
issue has no implications for this particular, higher quality, subset. We note that, by stating 
that the subsample with photometric redshifts is of lower quality, we do not imply that the 
problems arise necessarily from the photometric redshifts themselves, since we do not have 
the information needed to reveal the source of the discrepancies. The fact that the SN-ABC 
and GOODS classification for the SNe with spectra are in excellent agreement, shows that 
our algorithm works well. The fact that there are significant discrepancies when classifying 
SNe with no spectra indicates that the GOODS classification of at least some of these ob- 
jects might be erroneous. This may, alternatively, indicate a weakness in the method. If 
photo-z's confidence limits do not represent faithfully the true uncertainty in redshift, then 
our algorithm could give incorrect results. As in §3.1[ there are no objects with minimum 
X 2 values outside the 99% confidence interval. 

An advantage of our SN-ABC procedure is that it provides a quantitative indication of 
the quality of the classification, in the form of the P/ a value, that can be used for subsequent 
error estimation. The issues of classification and redshift uncertainties were addressed in 



Riess et al.l (j2004al ) by deriving sep arate Hubble d iagram s from the gold and silver samples 



(and ignoring the bronze sample). iDahlen et al.l (120041 ) deal with the uncertainties in the 



classification only (i.e., ignoring the possible errors in redshift determination), by testing how 



their results on SN rates change if the entire bronze sample is misclassified. IStrolger et al. 



(120041 ) used the entire GOODS sample, irrespective of quality, in their derivation of the SN 
la time delay distribution. The last treatment does not test for possible biases that arise 
from errors in classification or redshift determination. 
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4. Tests on a simulated SN sample 



While the GOODS sample is complete, it is quite small and even smaller when restricted 
to SNe with high-confidence classification. This motivates us to explore biases that might 
arise from our classification algorithm, and the dependence of the success rate on various 
parameters, by using a large simulated sample of SNe. The simulated sample also permits 
us to test the performance of the algorithm when the input data are additional CC types, as 
well as SN "impostors" such as AGNs. In §4.41 we examine the influence on the classification 
of having more, or less, than three photometric bands. 

We have randomly generated 5, 000 SNe of each of the SN types: la, Ibc, II-P, and Iln. 
To each SN we assign a redshift, an epoch, and a host extinction. These characteristics are 
drawn from a uniform distribution. While these are not the true distributions, intrinsic or 
observed, they hold two advantages for our objectives. First, flat distributions facilitate the 
discovery of possible trends in the reliability of the SN-ABC classification, by creating many 
SNe with every combination of properties. Second, the true distributions of SN rates as a 
function of redshift, type, extinction etc., are yet unknown, or highly uncertain. Assuming 
particular distributions could introduce unknown systematics into the comparative success 
rates. The results could also be used incorrectly to draw, for example, the overall contami- 
nation of a SN la sample by CC-SNe. The contamination fraction, while very valuable for 
many SN searches, depends strongly on the intrinsic rates of the different types of CC-SNe 
as a function of redshift. Such an estimate of contamination must therefore be tailored to a 
specific survey, taking into consideration the range of possible distributions in SN properties. 

For comparison of the results based on our simulated SNe to those based on the real SN 
samples, we mimic the observational properties of the GOODS sample with its three HST 
bandpasses, photometric errors and limiting magnitudes. The results in this section are for 
this specific configuration, and serve as an illustration of the capabilities of the SN-ABC. 



As in §2.21 we calcula te the synthet ic mag nitudes of the fake SNe using the SEDs from 
the spectral t empla tes of iNugent et al.l (120021 ) for types la, Ibc, & II-P SNe. Since the 
Nugent et al.l (120021 ) spectra o f type Hn SNe are theo retical blackbody SEDs, for this type 



only we use the templates from iPoznanski et al 



(2002). As in §2.21 absolute magnitudes and 



their dispersions are taken from iDahlen et al.l (12004 ) . The scatter in color within each type 
is applied to the CC-SNe by adding an intr insic, normally distrib uted, noise with standard 
deviation of o = 0.2 mag, the value used by lSullivan et al.l (j2006ai). The SNe la we sim ulate 
are given different stretches s, following the method described in lSullivan et al.l (j2006al ). We 
simulate a Gaussian distribution of stretches with an average of s = 1 and a dispersion of 
a = 0.25, truncated in the range 0.6 < s < 1.4. We model the s tretch- luminosity relation 
using the formalism M Bc = M B — a(s — 1) (IPerlmutter et al.lll999l ). where M Bc , and M B are 
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the corrected and uncorrected B band absolute brightnesses respectively, and the correlation 
factor is a = 1.47 . We also apply color-stretch corrections using the method presented in 
Knop et al.l (120031 ). by dividing the template spectra of normal, s — 1, SNe la by smooth 



spline functions, in order to match their restframe UBVRI colors to those of SNe with various 
stretches. We have measured the mean photometric errors of the GOODS sample in each 
band as a function of magnitude, and again assuming the noise is normally distributed, have 
added it to each object. We further assigned to the SNe a pseudo-photo- 2 with a\ = a 2 = 0.1 
(see TOTD . 



4.1. Type la SNe 

Figure [3] shows the average success rate of our algorithm, as a function of SN age and 
redshift, for three different stretch ranges. Each panel shows in contours the fraction of 
SNe la that are correctly classified by the SN-ABC, i.e., the fraction of SNe that are given 
Pj a values higher than half. The solid curves show the 50% success level, demarcating the 
regions of relative success and failure of the method. The regions of parameter space where 
we have no simulated objects (usually because they were too bright or faint to be in this 
GOODS-like sample) appear in white. As can be seen, the differences in plots for different 
stretch ranges are minor, showing that the diversity in color and magnitude among SNe la 
does not affect the classification significantly. In the subsequent analysis, we marginalize 
over the full range of stretch values. 

As can be seen in the top-left panel of Figure H] (which is basically a weighted sum 
of the three panels of Figure [3]), the SN-ABC success rate on simulated SN la data is 
high, greater than 90%, in most regions of parameter space. The notable exception to this 
success is the p o pulat ion of 1-2 months old, relatively low-;?, SNe. As already shown in 



Poznanski et al.l (120021 ). such SNe la have blue rest-frame colors that are similar to those of 
CC-SNe. Furthermore, the older the SN, the fainter it is, and therefore it can be erroneously 
fitted more easily with younger CC-SN templates, which are intrinsically dimmer. This 
means that, by excluding objects from a sample below a certain z, one can obtain higher 
classification success rates. The top-left panel of Figure [5] shows, for the same simulated 
SNe la, the average Pj a value (rather than the success rate) as a function of age and redshift. 
Clearly, most of the SNe are not only classified correctly but their classification has a high 
confidence, with an average Pj a greater than 0.8 in most regions. We also note, from a 
comparison of the top- left panels of Figures 0] and [5] that the average P/ a value follows quite 
well the actual success rate, meaning that it can serve as a reliable quality indicator. We 
have searched for trends in the success rates of the classification as a function of all the 
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other parameters, such as color, photometric errors, and extinction, and found no obvious 
correlations. 



4.2. Core-Collapse SNe 



In the three remaining panels of Figure HJ we can see that the picture is more complex 
within the zoo of CC-SNe. Most type-II-P SNe are correctly classified, being progressively 
better classified at later times. This is the complementary image of what we see with type la 
SNe. The colors of young II-P SNe resemble those of la SNe about a month past maximum 
light. For this reason type II-P SNe are also better classified at low z. 

The SN-ABC fails with type-IIn SNe, with about half of them being erroneously classi- 
fied as SNe la. This is the result of a degeneracy in color-magnitude space between these two 
types, and for which we have no straightforward solution. As already noted in §2.21 we do 
not use in the SN-ABC a set of type Iln templates, because their addition, while improving 
the classification of SNe Iln as CC-SNe, would considerably hinder SN la classification. Type 
Iln SNe likely result from the core-collapse of very massive stars (iGal-Yam et al.l 120061 ). the 
high-mas s tail of the initia l mass function, and are therefore suppressed in volume limited 
samples. ICappellaro et al.l (119971 ) measure their fraction to be ~ 2 — 5% of the CC popula- 
tion in the local universe. Nonetheless, due to their brightness, in magnitude limited samples 
their fraction could be as high as ~ 15 — 20%. For exam ple, in IAU circulars bet ween Jan- 
uary 2005 and Septe mber 2006, the Ne arby SN factory (jWood-Vasey et al.l I2004J ). and the 
SDSS II SN survey (IDilday et al.l 120051 ) . have together reported ~ 11 type Iln SNe out of 
~ 55 CC-SNe. SNe Iln appear to be an important contaminant of future SN la samples, and 
may cause difficulties for cosmology oriented studies. This may have alrea dy affected some 
curren t studies that relied to some degree on photometric classification, e.g.. lBarris &: Tonry 
( 120061 ). Such contamination could explain th eir measured SN r ates, which seem inconsistent 



with other published results, as discussed by lNeill et al.l (12006). The possible contam ination 



of SN-Ia samples by type-IIn SNe has also been discussed by 



Germany et al.l (120041 ) . 



Our algorithm correctly classifies most type Ibc SNe as CC-SNe, but with lower success 
rates than type II-P SNe. Considering the fact that we are using II-P templates to recognize 
Ibc events, this should not be surprising. As with SNe II-P, when SNe Ibc are near peak, 
their colors are degenerate with those of SNe la. A caveat however, is that the templates from 
which we have simulated the type-Ibc SNe may not truly represent the high-z population, a 
possibility that must await future spectroscopy of such events. As was the case for SNe la, 
we find no trends in the SN-ABC results as a function of all the other simulated parameters, 
such as magnitudes in the different bands, photometric errors, and extinction. The upper- 
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right and two bottom panels of Figure [5] show that for CC-SNe, as was the case for SNe la, 
the average Pec values follow the success rate of the SN-ABC; when the success rate is low, 
the Pec values are, on the average, also lower, indicating when the fit is poor and thus 
serving as measures of quality for the classification of each object. 

In order to simulate "rolling" surveys, where a field is imaged repeatedly, and the SNe 
are found when they are young, we have run simulations using only SNe younger than three 
weeks past explosion. Assuming a young SN age during classification, i.e., marginalizing 
the likelihood only over the relevant extent in age, improves the success fractions of the 
SN-ABC significantly, as expected, since it removes many of the young vs. old degeneracies. 
The improvement depends on the redshift range and SN type. For example, for redshifts 
between 0.4 and 0.6, the success fraction for SNe la improves from 91% to 93 

4.3. Misclassification and Contamination by AGNs 

The fractional contamination by false positives (e.g., non-la's among SNe classified as 
la) will depend on the intrinsic distribution among types in a given survey, which depends 
on the depth of the survey. For example, shallow, flux limited, SN surveys at z ~ 0.1 
find, following spectroscopic confirmation, an 80% la fraction (Gal- Yam et al. 2007 in 
preparation). Since this fraction is based on a small number of SNe, we will assume it 
could be as low as 50%. We will also assume for simplicity that the CC-SNe are equally 
divided between the three subtypes, II-P, Iln, and Ibc. The following numbers depend 
weakly on this assumption. Averaging over CC-SN subtypes, about 30% of the CC-SNe 
in this redshift range (z ~ 0.1) are misclassified as la's, while about 90% of the la's are 
correctly classified as such. This gives a fraction of false-positives among the SNe la in a 
photometrically classified survey to this depth between (0.3 ■ 0.2)/(0.3 • 0.2 + 0.9 • 0.8) = 0.08 
and (0.3 ■ 0.5)/(0.3 ■ 0.5 + 0.9 • 0.5) = 0.25. Alternatively, in deep surveys such as GOODS, 
about 50% of the SNe are CC at 0.3 < z < 0.9, and the misclassified CC fraction is ~ 35%. 
The SNe la are mostly at 0.5 < z < 1.2, ~ 90% of which are correctly classified, hence the 
contamination fraction is slightly higher, of the order of (0.35-0.5)/(0.35-0.5+0.9-0.5) = 0.28. 
In the absence of detailed knowledge about the intrinsic SN type and redshift distributions 
in a survey, the errors and biases introduced by misclassification are best estimated using 
simulations that test what are the ranges of intrinsic distributions that could plausibly 
produce the actually observed, photometrically-typed, distribution. 

We have calculated for each of the simulated SNe the \ 2 value for the best fitting 
SN template. The \ 2 distribution for each of the SN types can be seen in Figure [6j The 
distribution is similar to the expected \ 2 probability density function with one degree of 
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freedom. Had our model been linear, and its parameters non-degenerate, we would have 
expected to have zero degrees of freedom, since we fit three parameters (redshift, age, and 
extinction) to three data points per object (the magnitudes in three bands). Fortunately, 
our model is non-linear, and has some degeneracies between the parameters, so that useful 
information can be extracted, as we have shown. From the distribution of \ 2 values in the 
simulations, we can derive the 99% confidence interval, which can be used to reject objects 
which are poorly fit by all of our models. Such objects could be peculiar types of SNe or 
SN impostors (e.g., AGNs, the major contaminant in SN surveys) with significantly different 
colors. As already noted, in SNLS and GOODS, all the SNe we examined had \ 2 values 
smaller than the 99% confidence limit of the simulated dataset, meaning there were no true 
SNe that were misclassified as peculiar/impostor SNe. In our application of SN-ABC to a real 
"spectroscopically blind" SN survey, we can use the x 2 criterion to assess the contamination 
by peculiar events and by AGNs. We test this on simulated AGNs in the following section. 

Using the same approach used to simulate a SN sample, w e have generated 400 moc k 



AGNs using as a template the composite AGN spectrum from IVanden Berk et all (120011 ) 



and a redshift dependent luminosity function from lBoyle et al.1 (l2000f ) . We have extrapo lated 
the function to low luminosities based on the evidence presented in I Wolf et al.1 (120031 ). We 
expect, at least in some cases, the photometric redshift to fail due to the contribution of 
the AGN to the colors of the host galaxy. As an approximation of this ef fect, we generat e 



for each AGN a random host galaxy drawn from a Schechter distribution (ISchechterl Il976l ) . 
If the AGN luminosity is smaller than the galaxy's, we assume the photo-z works well, 
and otherwise we generate a completely random photo-z. Among the AGNs, 265 are first 
classified as CC-SNe according to their Pj a values, and the remaining 135 as SNe la. After 
applying a \ 2 cu t, at the 95% confidence limit, 189 of the CC impostors are rejected, but 
only eight of the la impostors. There is no significant difference between the samples with 
'good' and 'bad' photometric redshifts, so our approximation for the redshift determination 
is inconsequential. 

Thus, we can reject more than half of the AGNs we simulate. The remaining objects 
contaminate in about equal fractions the la and CC-SN samples. Note that in any search 
that includes more than two epochs, most of these AGNs will be rejected due to their non- 
SN-like variability, and survey-specific simulations can be carried out to test for the existence 
of residual contamination. 
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4.4. Number of Photometric Bands 

So far, we have studied the performance of the SN-ABC when classifying SNe with 
single-epoch photometry in three bands. We now examine the effect of using more or fewer 
bands on the classification success rate. 

We begin with the addition of observations in a fourth, bluer, band, specifically the 
HST F475W filter. We repeat the simulations presented in the previous sections, though 
with fewer SNe (500 of each type), due to computational limitations. Comparing the results 
shown in Figure [7] to those obtained with three bands in Figure HI one can see that although 
there is some improvement, it is not striking. The overall success rate for SNe la (top left 
panel) improves marginally, mainly through a better classification of 1-2 month-old SNe at 
low redshift. However, as can be seen in the remaining panels of Figured for the CC-SNe 
of the different subtypes, the improvement is less significant, and is null for type-IIn SNe. 

In order to test whether this improvement remains marginal for real data, we used the 
SNLS sample which has g-band observations for some of the SNe. We repeated the process 
described in §3.1.1[ with the fourth band added, and o\ — o-i = 0.1. In this case 99% of the 
la SNe are correctly classified (only one misclassified) , with 74% having Pj a > 0.9. While 
this is better than with three bands, it is not a dramatic improvement. For <j\ = o<i = 0.3, 
the correctly classified fraction of SNe la rises from 76% with three bands to 84% with four. 
The SNe II-P are only marginally better classified, but the sample with observations in four 
bands consists of only eight such objects. We thus conclude that, when the photometric 
redshifts are reasonably good, observations in a fourth band, for the sake of classification 
purposes, may be an inefficient use of telescope time. 

Next, we examine the success rate of the SN-ABC when using observations only in two 
bands. Since the best bands for high- z SN observations are the reddest, we discard the bluest 
band, and remain with F775W and F850LP. As expected, with two bands the results, shown 
in Figure [HI are degraded. Nonetheless, in some regions of parameter space, the success rate 
of the SN-ABC is non-negligible. SNe la show the same change as when dropping from four 
bands to three. The success rates drop especially at low redshift and for old ages. On the 
other hand, surprisingly, the success rate for II-P and Ibc SNe is usually higher with two 
bands than with three. This could be understood in the following way. As described in §2.2[ 
our model for the absolute magnitude of CC-SNe includes a much greater dispersion than 
that of SNe la, in order to account for their intrinsic diversity. This entails that CC-SNe can 
populate wider volumes of color-magnitude space, so that when observational constraints 
are weak (with one or two bands observed) summing the likelihood over all parameter space 
makes the evidence E C c greater on average than E Ia , and thus increases Pec for all objects, 
regardless of their real type. As a consequence, SN la classification is hindered, while CC- 
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SNe are apparently better classified. We have tested this explanation by reducing artificially 
the dispersion of CC-SNe in our model. As a consequence, SN la classification improved 
dramatically, regardless of the number of observed bands, while CC-SN classification success 
was correspondingly reduced, being worst with the least number of bands. 

Even with only one observed band (the reddest, F850LP), as can be seen in Figure HI 
the SN-ABC manages to classify successfully some SNe, e.g. 75-85% of all the SNe with 
redshifts z > 0.7, excluding SNe Iln. This is mainly due to the fact that, at least in our 
models, SNe la are significantly brighter than most CC-SNe, which is enough to differentiate 
(probabilistically) between la and CC-SNe when the redshift is constrained. 

Finally, AGN rejection, while improving only marginally when adding a fourth band, 
is weakened considerably when discarding information in one or two bands. This comes 
from the longer tail of high values that the y 2 distributions have in these cases. Such a tail 
increases the 95% confidence limit by a factor of ten, when compared to the scenarios with 
three or four bands, and does not allow the rejection of any AGNs. 

Thus, while some classification can be done with one or two photometric bands, the 
biases in the resulting samples are stronger and the success rates are rather low. On the 
other hand, four bands seem not to be worth the extra observing time, over observations in 
three bands, if the sole sole purpose is to classify the SNe based on single-epoch data. This 
also suggests that, with better sampled light curves, the added value of a blue fourth band 
is small. 



5. Conclusions 

Using the SN-ABC, a Bayesian algorithm, we have studied the feasibility of a probabilis- 
tic automatic classification of SNe, based solely on single-epoch multiband photometry and 
prior redshift information. While photometrically classified samples are far from competing 
in precision with spectroscopic samples, they could be an important source of information on 
the rates and statistical properties of SNe. We have tested our technique on samples of SNe 
from the SNLS and GOODS projects that have spectroscopic classification, and on artificial 
datasets. For most samples and settings our method is promising, with high success rates. 
When assuming reasonably well-measured photometric redshifts, the SN-ABC correctly clas- 
sifies 97% of the type-la SNe from SNLS, and 85% of the type II-P SNe. Similar numbers 
are achieved for a subset of the GOODS SNe for which there are spectroscopic redshifts. 
In artificial samples, we have shown that SNe la are best recognized at z > 0.6, or when 
near maximum, with success rates of the order of 95%. Core-collapse SNe are best classified 
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several weeks after maximum, or at z < 0.6 Using the artificial samples, we have shown 
that, when taking into account the whole zoo of CC-SNe, complications do arise. Specif- 
ically, type-Ibc SNe are not as well classified, and type Iln SNe are usually misclassified. 
For surveys where SNe are found young, classification success fractions improve, by a degree 
dependent on the SN type and redshift. The fractional contamination of a single-epoch pho- 
tometrically selected sample of SNe la by CC-SNe, could vary between less than 10% and 
as much as 30%. The errors and biases introduced by misclassification are best estimated 
using simulations that test what are the ranges of intrinsic distributions that could plausibly 
produce the actually observed, photometrically-typed, distribution. 

An additional feature of the SN-ABC is the ability to reject SN "impostors", mainly 
AGNs, using x 2 statistics. In our simulations half of the AGNs we simulated were rejected 
when using a x 2 confidence limit of 95%. While we have focused on SNe observed in three 
bands, we have found that a fourth band may be of little additional benefit for the purpose 
of classification, while with fewer bands some classification is still possible. AGN rejection, 
however, fails with fewer than three bands. 

In all the cases studied, the output values, which we use to classify the SNe, P C c and 
Pia, are also indicative of the quality of the fit, and the reliability of the result. The mean 
values of Pec and Pj a track the success rates of the SN-ABC, and can be used both to define 
subsamples with lower uncertainties, and to estimate confidence intervals. Methods such 
as these, and their future refinements, are a prerequisite for pushing the exploration of the 
SN population to fainter magnitudes and higher redshifts. A public release version of the 
SN-ABC is in preparation. 

We thank the SNLS team, specifically R. Pain and P. Nugent, for access to SNLS data 
and valuable comments, and S. Leach, E. O. Ofek, and K. Sharon, for useful discussions. 
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Fig. 1. — Classification of SNe la from SNLS. Left: distribution of the type determination 
parameter Pj a for different redshift priors. Values of Pj a higher than 0.5 mean the object is 
probably a SN la, while smaller than 0.5 mean it is a CC-SN. Right: posterior redshifts for 
the priors on the left. Solid line is z pos terior — %>ec, fc> r reference. The SN-ABC works well, 
assuming high quality photo-z values are available (upper two panels). 
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Fig. 2. — Same as Figured], for SNLS SNe II-P with four different redshift priors. 
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Fig. 3. — Classification success rate for simulated type-la SNe with three stretch ranges, 
as marked, as a function of redshift and age. Contours trace /(Pj„ > 0.5), the fraction of 
SNe that are successfully classified (i.e., having Pi a > 0.5). The solid curves show the 50% 
success level, demarcating the regions of relative success and failure of the method. Regions 
of parameter space where we have no simulated objects (usually because they were too bright 
or faint to be in this GOODS-like sample) appear in white. Note the similarity of the three 
plots indicating a weak dependence of classification success rate on the SN stretch/absolute 
magnitude. 
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Fig. 4. — Same as Figure [BJ but for simulated SNe of types la, II-P, Ibc, and Iln, as marked. 
The top left panel is effectively the weighted sum of the three panels of Figure [3j Types II-P 
and Ibc are correctly classified as core-collapse SNe for a large range in age and redshift, but 
SNe Iln are generally misclassified as SNe la. 
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Fig. 5. — Same as Figure HI but plotting contours of mean Pj a (top-left panel) or Pec (top- 
right and bottom panels) values for simulated SNe of types la, II-P, Ibc, and Iln, as marked. 
The solid curves show the P = 0.5 level. Note the similarity with Figure HI indicating that 
the SN-ABC output, Pia/cc, is a good indicator of the reliability of the classification. 
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Fig. 6. — Measured x 2 distributions for the sample of simulated SNe, by type, and for all 
types combined (thick solid histogram). The thick dashed curve is the expected distribution 
for one degree of freedom, normalized to the total number of simulated objects, and matches 
well the measured curves. 
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Fig. 7. — Same as Figure HI but for simulated SNe observed in four bands, rather than three. 
Four bands improve the classification success rates of old, low-z, SNe la, but have little effect 
on the success of CC-SN classification. 
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Fig. 8. — Same as Figure HI but for simulated SNe observed in only two bands (F775W and 
F850LP). As expected, SN la classification success is reduced significantly. For CC-SNe, 
classification success rates are somewhat higher than with three bands, as explained in §4.41 
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Fig. 9. — Same as Figure HI but for simulated SNe observed in just one band (F850LP). 



